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ABSTRACT 


The paper addresses 'he Following problem: Given an array of hght intensifies obtained from 
iDrna scene, Find tin: light sources in the original scene. The following (actors are discussed 
from the pool of view ol Iheir reievance 10 I>gh1 sources delecliOn: The highest intensity irt 
the scene, aosO : ute inlensily value, local and giobal contrast, comparison with (he frvorage 
intensity, and lightness compulation. They ere shown to be insufficient for explaining humans" 
ability fc identify I gh-t sources m thrir vmiinl field. Finally, a method for aOc Omplishing. the 
source dated ion task in the mOndrian world is presented. 
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Gn Visual Detection of lught Sources. 


1 - The Problem. 

1.3 It is sometimes illustrative to thin* of some of the research done in Lower Level Vision 
as aimed at answering the following question: Suppose you are given the diagram 
illustrated below, which is an array of light intensities taken from some picture. The 
question is; what Is thene^ 

*2 74 60 121106 71 23 70 64 47 ||£ 30 70 123 300 44 100 6G 4? 40 304 
45 35 20 1211L6 ]?L 37 30 46 125 37 3? 34 64 25 40 103 72 67 77 105 3 
47 22 70 LE4 57 56 30 16 55 43 32 26 116 54 32 43 43 57 43 65 71 14 17 
63 LI3 127 17 73 33 42 32 76 7p J30 56 15 23 22 56 72 ]|4 24 115 70 121 
9 62 73 11 23 63 47 73 HI 61 42 65 13] 74 57 26 130 122 41 123122 127 
!2J 34 63 M2 66 22 20 64 123 46 62 30 L4 27 36 64 22 5? 13 H5 35 74 
EI5 123 122 55 72 L14 24 135 % 12132 E35 35 64 25 20 55 12 73 15 23 65 
47 73 111 61 42 65 131 74 57 126 130 E22 141 125 122 127 123 41 15 102 33 
47 77 7.5 H3 102 42 106 32 10 3C0 103 |M 60 121 36 32L 37 20 106 111 115 
23 45 42 74 60 85 77 7J 23 70 64 47 112 30 70 123 1QQ 41 103 66 4? 35 
45 35 20 121 SIS L21 37 30 46 125 37 32 54 64 25 40 305 72 67 77 83 9L 
12 73 123 123 63 47 73 111 61 42 65 131 74 57 26 130 122 t4l 125 122 127 

The correctness of the answer to the quest Ion "What is theie 5 " is to be determined by 
its consistency with people's response io the same question, when presented with the 
corresponding picture. The mam point :s toemphasne that the only data available to the 
visual system is an array of light Intensities, or perhaps a few of them for the different 


kinds of receptors in the eye. 


In the particular problem addressed here, the general problem "Whit is there? - is 
replaced by "where are the light sources in the picture". As the answer we are aFter is to be 
consistent with human competence, it is natural to ask whether people are indeed capable of 


detecting light sources in their visual fields. The answer is that ill many cases they 
undoubtedly are. For example, in most cases, tt is easy to tell whether a light bulb is turned 
on or ofT, A simpbe demonstration nf this ability is the use of brakes-lighi in automobiles as 
a warning system. This is not to say that humans can always detect light sources correctly. 
On the contrary: we cannot detect a weak iLght source if the background is too bright, e.g 
Stars ml daytime, while on the other hand, areas which are not actual light sources are 
sometime perceived as such, as in the case of the retro-reflecting shining signs on the 
highways. However, the interesting point, as we shall see, IS not that we occasionally make 
erroneous judgments, but that id many situations We make the right ones. 

The problem of detecting light sconces. has been confined here to "Achromatic 
Mondrians". By an Achromatic Mondrian we mean an array of rectangular shapes, of 
different sues, a.hd different levels of bkek. grey and, white, at in picture ?. The term 
"Mondrians' for such arrays was used by E. Land and j, McCann, [Land 197J) due to their 
resemblance to the paintings by Piel Mondrian. These Mondrians serve to Simplify the 
environment, especially by excluding colors, (Evans, in [Evans ISft'H] has some work on the 
contribution of colors to the perception of fluorescence.) and by discarding both shadings 
and the type of 'fuzzy" light sources, shown in picture l 

The Mondrian is Composed oF pieces oF paper, glued together onto a white, 
transparent, background, sheet. It is then placed on a thick piece of cardboard. Sy making 
a hole in the cardboard, and placing it above a fluorescent lamp, ibe area above the hole 
becomes a uniform light source. 

A subject is then presented with the Mondrian, and asked whether he detects any 


light source in L[. and where The questions we raise are, under what conditions will the 
subject be able to detect light soutaes in the Mondrian, and by what possible methods can 
such a task be accomplished 

S* 3lx possibilities, and a discussion of their insufficiency. 

We shall pTocred by examining the following six factors from the point of '-■icw of 
tbeif relevance to Ijghl-SDurces detection. 

I The highest intensity in. thE visual field. 

2. High absolute intensity value 

3. Local contrast. 

4. Global contrast. 

5. Intensity compared, with the average intensity in the scene. 

6. Lightness computation. 

We shatl conclude that even in the Simple cass of the Mondrian, these factors are rot 
sufficient to account for the ability of human subjects tn detest light sources in their visual 
fLeid. The following notations are usee in the sequel: The light falling on the Mondrian is 
called the Jtfunfndfjpn,, and IS denoted by ']" The radiant area in the Mondrian is denoted 
by "A*; the light transmitted through it is called the irmrcrluuintiwy, and is denoted by "L‘ 

2,1 The highest intensity in the scene. 

A perceived light source is not necessarily associated with the highest hghi intensity 
in the field. Suppose, for example, that we create an iliumination gradient, and at the place 
where .he intensity is low, we pla.ee a weak light source. The intensities can be set in such a 
way, that the Light source will be perceivable’, while the intensity graph will loo!* tike that in 


Figure I: 

The intensity at S is higher 
than the intensity at A. tt is, in 
fact, the highest intensity in the 
scene. Still, only A is perceived 
as a light source. 



Thus, having the Highest intensify in the scene is neither a necessary, nor is it, 
obviously a sufficient condition, for teing perceived as a light souiCo. 

2 % High absolute intensity value 

A light source is not necessarily associated with an area of high absolute intensity. 
Against a dark enough background a firefly is perceived as a light source, although the 
ahiolute Ugh? intensity earning from it is very low. We shall resume this subject of absolute 
intensities after describing the results of two Simple experiments which will help tq elucidate 
our point,, as well as serve as an introduction to the nest section. 

Experiment It [f, at a given illumination I, tot begin with a very low source-itiTenMty and 
gradually increase it, the fallowing happens. At fust, the source is not -detectable. When it 
grC"WS stronger, there IS a range of Lincercamty, and then, finally. It becomes prominent. The 
range of uncertainty is bounded by two ’‘threshold^- the lower threshold is the source 
intensity far which the subject suspects for the first time there might be a light source there; 
the upper threshold is the source intensity at which he becomes sure. This distinction is 
important when carrying out experiments with a “just noliceable' light source, as it specifies 



the experimental condition more precisely 

Experiment 2: If fhe source intensity a sec ju^t above the upper threshold, and we 
gradually IncreaK fhe illumination, the reverse process tates place, via the Upper threshold, 
Che range of uncertainty. and the lower threshold, to a situation where the source is no 
longer detectable- 

In this test experiment where L was constant and 1 increased, the total intensity 
coming From area A increased, while at the same time it ceased to appear as a light source- 
Thc conclusion Js that it was not the high intensity value at A that made it appear radiant. 
Rather, it seems that the major rote was played by the ratio between the intensity at A and. 
that of the surroundings. We shall turn therefore to consider this raLiO. 

2.$ Contrast: 

A variable that seems suitable to explain the above results, is the contrast The 
contrast b-etween intensity h and intensity it can be defined as (b - Ii) I (li + li). As- this 
contrast ls a monotonic function of li/li, (assuming b/li JS positive) high contrast simply 
corresponds to h bemg "many times" greater than It 

We can now explain the experiments described above in terms of contrast Suppose 
w-e have an illumination l = ICO units on some arbitrary scale. L ■» 100 units, and instead of 
a Mondrian we have a uniform surface with reflectance *■ D.5 (that is. it reflects 50 of the 
the incident light,) The light intensity coming from A will be LOO (source intensity) * LOO « 
0.5 (reflection), that is. 150 units. From the surroundings, we gee only the 50 units of 
reflected light, so that fhe ratio js 3:1, or the contrast is 0.5. If the illumination is raised to 
3000 unite, rhe new intensities ratjo between A and ihe surroundings will be only 6:&. 




Although the light intensity at A is higher this lime, the contrast IS much tower, only 1/11. 

A plausible conclusion from the discussion so far is that whenever the contrast 
between a stimulus A and its surroundings exceeds a certain value, the former is perceived 
as a Light source. There is a kind of "rationale" to such a conclusion: Surfaces in naCLlrt do 
not usually have reflectivity values approaching the extremes of LOO nr D . A very high 
contrast value is Thus not lively to be achieved by reflecance changes alone; rather, it might 
indicate the preswi™ of a light source. 

A question; of interest at this point is "just how high IS high". Namely, how high art 
Che contrasts found in haemal, scenes without light sources, and what contrast is needed for a 
light source to he just noticeable (that is. just above ?he lower threshold). These values were 
measured in is scene containing pieces Of a very White paper, a very dark paper, a Strip of 
shadow, and a light source at the tower threshold intensity. The nreasurements were 
performed using the A.i. YidLcon, from which the real intensity values are difficult to 
obtain. The following results should serve, therefore, more as indications of the relative 
magnitudes than as accurate absolute values. 

The following ratios of intensity values were computed 
White to black ratio: 6-9 White to shadow ratio: I3-JT 

Source tb black ratio: 11-15 Source to shadow ratio: 19-33 

In contrast wirh these high values, a light source was also perceivable in a picture 
where the ratio of intensities was m no place higher than 1.3. Thus, the perception <?r a 
light source cannot be identified with Chat of a htgh enough contraSf, While a high enough 
contrast seems, as far as I have been able to determine, sufficient to induce Che perception of 




a light source, it is not a necessary condition. In otlier words, the prince of a light source 
tan be deduced, from factors} ocher than conit SSL. The rest of the paper ls an attempt to 
find such a factor. What makes the question intriguing is the fact that there does not seom 
to be an obvious candidate for Che tail. 

We proceed by discussing some Of the more immediate candidates for a Solution, and 
show their inadequacy. They are; global as opposed to local contrast* average illumination, 
and lightness computation. 

£.4 Global versus local contrast: 

Consider the situation in'picture Z The source intensity was set at the lower 
threshold. PictUK 3 Ls oF the same setting, only this time With a dark, area surrounding the 
light source. The contrast between the source and its immediate surroundings is thus 
multiplied by 6 9 Thos change in contrast did not, however, make the light source more 
noticeable. The :oirowing claim can be raised here, the change Lft Contrast between pictures 
* and i is only in the immediate contrast, that is, between the light source and its immediate 
surroundings. The global contrast, namely between the light source and the darkest area in 
the field, had however not been effected I therefore repeated this experiment* this time 
changing the global surroundings as well, and with similar results. Using the above 
distinction it can rww be staled, that light sources are sometimes detectable when loth the 
global anti the local eonirasts were low, therefore neither LS a necessary condition for the 
iource detection. 

2.5 Average illumination: 

Another factor that had been considered, is the influence of changes in che average 





illumination. Will the thresholds of detection become low^3T H If we use, for example, a darker 
Mondrian (while maintaining both global and, immediate contrasts Fixed)? Mo such 
influence ha s been detected. 

32-6 Lightness computation: 

finally, let me turn to a bner analysis of the above results in terms of lightness to see 
whether fhis approach provides us with the icy to the detection of low-contrast sources 
The computation of lightness from Intensities (See [Land 1971], [Horn MWH]) involves the 
sepAration of sharp intensity changes from gradual ones. Thus, an intensity graph like the 
one shown in figure £ A, wdt be decomposed mto a sharp-changes component (figure 2B) 
and a gradual-change component (figure 2C), 



Figure 2A Figure 2B Figure 2C 

One might try to use thl£ decomposition to explain the fact that A is perceived as a 
light source, although the intensity at B is highei if the lightness contrast is computed 
instead of the intensity contrast, then area A obviously gets the highest value. Examination 
of the experimental data reveals, however, that the computation of contrast via hghinesi, 
does not help solving the basic problem contrast is still not a necessary condition. The 











visual sys.tem somehow distinguishes between possible .interpretation* of the scene: a contrast 

created bp light-and-dark surfaces on the one hand, and a COUtraST created hy the presence 

of a light source on the other To make the problem of 'more than one possible 

interpretioiV clearer, consider the following intensity array: 

44 43 43 42 42 4HL 40 40 110 109 105 ID? LCG 105 L04 103 102 101 100 50 40 4-S 4? 46 
44 43 43 42 42 4l 41 40 40 110 I Oft 135 107 106 105 104 1 03 102 101 ICO 50 4 9 4 5 47 16 

44 43 43 42 42 4L 41 40 40 1L0 LOft 106 107 106 105 504 LOG L02 101 100 50 4ft 4 & 47 46 

44 13 43 42 42 41 'll 40 IQ HO m I0S JO? IDS 105 104 L03 L02 101100 50 4ft 4& 47 46 

The corresponding lightness matrix discards slow changes and therefore will look like this; 

SO 30 30 30 30 30 30 30 30 100 ICO LOO LOO LOO LftQ LOO 100 100 LOO 100 50 50 50 50 50 

30 30 30 30 30 30 30 30 30 IOC ICO LOG LOO LDO LOO LOO 300 100 100 100 50 50 50 50 50 

30 30 30 30 30 30 30 30 30 100 LOO LOO LOO LOO IDO 100 100 LOO 100 100 50 50 50 50 50 

30 30 30 30 30 30 30 30 30 LOO L&0 100 LOO LOO LOO iOO 100 LOO 100 LOO 50 50 U 50 50. 

[n both cases, There is more than a single passible Intcrpietaiion. One Interpretation 
is that the areas simply have different reflectivities. Thus, the central area can be 
normalized ro 1-0, and Che Left and right areas assigned the values of 0.3 and 0,6 respectively. 
A different interpretation is that the right area has a reflectivity of 1.0, the left - 0.6, and the 
center is a light source. 

To be sure, if we knew the real reflectance w one area,, we could have determined (at 
least in the case of Mondrians) all the reflectance values m the picture, and then we could 
have also assigned the label "light source" to areas of reflectance greater then one The only 
trouble with this method ii that there does not seem to exist a way of determining real 
reflectance values. ShlL, in many cases the Visual system is able to make ibe right 
interpretation of the scene, In a picture rather similar to the anay presented above, but 
with even less contrast, a light source had been perceived. That is, the visual system 



managed to somehow pick (correctly} the light-source interpretation How car> this be dome? 
The following section. propose* a method. 

3* The proposed rrteth od, 

General description of the method. 

ftoughly speaking, the proposed method IS the following: 

Given two adjacent areas, compute both their ititensJiy-ratiO and then gradiexit*ratio, and 
compare the two. If the ratios are not equal, one of the areas is a light source. 

Et Is based on the following two observations: 

1. All that is needed for the detection of a light source, is the COX reel values of the reflectance 
ratios in the scene. 

2. In man} 1 eases this real ref lectance ratio can be computed* even in the presence of a light 
source, by comparing Inferutty grodlfufj. 

Let me discuss each in turn. 

I. Using the value of Wri): 

The preceding wet ion seemed to imply that a correct normalisation of the 
reflectances is needed m order to detect light sources, by Identifying them with areas of 
reflectance greater than i. Et turns out, however, that we don’t need that much 

Consider two adjacent areas: area no 0 arid area no. Land suppose that wc somehow 
know jhe reflectance ratio rw'n. Assuming the illumination is a continuous function of che 
position, we can then determine Whether one of the above areas U a light source- The 
continuity of I implies that the illumination on IhP two Sides of the borderline between the 



areas ls approximately equal, If the measurements are taken close enough to the boiderllne. 
From this equality it follows that if neither of the areas Li a llghr source, the Intensity ratio 
should equal the reflectance ratio. Hence, if the Jitio values do not agree, we tan deduce 
the presence of a light source and. as Lt turns Out. we can also compute the actual source 
intensity. 

2 Computing Wn) from gradients: 

As had been mentioned above, the Cully value* permitted In the computation arc the 
Intensity values at different point? in the visual field. The way used boih by Land, and 
Horn to determine reflectance ratios from these intensities is basically the following: Find 
the points, of sharp changes in the intensity distribution, like point A In figure % 

Then conclude that; 
the ratio rifn is 
equal to the tatio e<dei 
when tt is measured to 
the left af the "jump" A r 

Figure $ 

and ei is measured to the right of it. This computation, however, presupposes the existence 
of no tight sources in the picture. Foi otherwise It might be the case that, for example, ra - 
n r but there ls a Ughi source at area 0 which creates the intensity jump aL A. That is to say. 
In order to compute the reflectances ratio we need first LO discover the light sources, and in 
order to discover the light sources we need the reflectance ratios! Here jj a way out of this 
circle. Suppose, (and this it usually the ease), that the illumination is noL absolutely uniform, 





has a gradient which over some area is more or leu linear, say a gradient or IOC 
intensity unit* to an inch When such an illumination is reflected from a surface of 
ref lectance K.. not Duly is the overall intensity reduced by a factor of K" the gradi ent! will 
be K times the original bhe as well 

in figure 4, the reflectances are taken to be 1/2 in area 0 and 1/4 in area i. 

Note that not only is Win - 2, tntmstly 

but SVSn also is equal to 2; 
where $a is the slope of the 
intensity graph measured 
from A to the left, and 
Sn is the slope measured from B to 
the right. 

Figure 4 

If we now add a uniform light source La area 0, the ratio WI* will change, but the 
ratio Sa/Ss will remain the same , and JflU equal to re/n. £* and Sn can, of course, be 
computed from rhe intensity values alone. 

Thus, we can use the gradient ratio to compute the reflectance ratio, and then use 
this ratio as shown in the preceding section to test for the presence of a light source. Next, 
we shall describe how rhe computation is actually- implemented. 

3-2 The "SdUTCe Operator" and Lts implementation. 

Few notations: as before, ] denotes the illumination, L - the source intensity (the 
source is assumed co be in area 0). S is the gradient, r denotes rhe reflectance and e stands 











for inremsiiy of the light reaching the eye. Note chat e h the only parameter we are 
allowed to measure. The discussion so far shows that from the obvious relation: 


(LJ cp ■ '(Jo (f ri) t L 

we can deduce that opd?: "smooch" illumination- 
(2) L - es - cl » (Sb/SJ 

if the points G and E, where the measurements are taken, are close enough to each other. 


However, "real life’ measurements tend to Iwk more like figure S. 
In this case we can tarenuiy ^ 


no longer suppose 
that I* is equal to Ib, 
as they are too far 
apart. Rather, it is: 

Ed - 1a* Kl' 



Figure 5 

Where K is the intensity gradient in intensity units per unit distance, and d is The distance 
of & From A. Starting wj(h the underlying equation 0), L<ei-n» la, we now get: 


L - eo ri Mil - ltd} *■ El - hn - ruK-dl 
- eo ■ ei h (.rsjn) + S*d (Since nsK = Si) 

This last equation. wjth the slopes replacing the reflectances: 


(S) L * et - ei ^ (SifSi) *■ Snd 
will he referral to as the "S-Operator" 






It is a rather straigh(forward task to implement the i>-Operator and run it on actual 
intensity arrays, SevesraI details have to be a.dd-^di, mainly to cope with the problem* of noise 
arid. iniufficLeni resolution of the Vidican. For example, the right-slope at point i cannot be 
computed simply by s SFty, [{m) - 1(a): rather some averaging ]3 needed. En the program thii 
average is taken over a distance which varies with the situation Another example Is the 
treatment of irregular points, whose intensities are except tonally higher or lower than their 
Surroundings. It so happens that in most cases they are lower, due peihapS- to dust bn the 
lenses. 

Figure 3 at the end of this section shows the intensity distribution obtained from a 
scene which contained a light source to the right of point A. Figure "? shows the 
corresponding output of the S-Opcrator. As negative 3-values are meaningless in the 
particular algorithm that had been used, the output can be taken as the maximum of 0 and 
the computed 5-values, as in figure A. The 'Source value" ls the highest at the real source 
borderline. Its relative magnitude IS enough to allow the setting of SOrne threshold, above 
which an area can be labeled as a light source In the general esse, this threshold has- to 
depend on the overall intensity. An S-valuc of JCC units, which is nuc significant when the 
intensity is around 5000 units and with a noise level of FCO, is significant indeed when the 
intensity is around LOO and the nmse lovel a round 10 units. This fact contributes to the 
phenomenon that a light source, which is detectable at low illuminations, becomes 
undetectable at higher ones 

A Final remark: The above method raises the possibility of detecting a "dark light 
source" An area With an average intensity of, say, 0.3 that of its surroundings, might be 


declared" as a light source* if the Sight gradient there is only, jay, 0.4 the gradient of the 
surrounding! Es it possible to construct a situation In Which an area with light intensities 
thin ^e surroundings will be perceived as a light JSUice? Although some experiments 
have been earned blit, I don't yet Know the answer to this interesting question. 
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